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We present the results of searches for B decays to the two charmless two-body final states B — ► 77^*° and 
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H , second systematic. 
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1 Introduction 

We report results for searches for B decays to the charmless two-body final states B° — ► r]K*° 
and B + — » 7]K* + [y . These processes are manifestations of penguin or suppressed tree amplitudes 
proportional to small couplings in hadronic flavor mixing (CKM matrix Q). As more of these 
rare decay modes are measured, their phenomenological description will improve, and with it the 
sensitivity to any contributions through virtual particle loops or interference terms of heretofore 
undetected physics. 

2 The BABAR detector and dataset 

The data were collected with the BABAR detector Q at the PEP-II storage ring Q located at the 
Stanford Linear Accelerator Center. The results presented in this paper are based on data taken 
in the 1999-2000 run. An integrated luminosity of 20.7 fb _1 was recorded at the T(4S) resonance 
corresponding to 22.7 million BB pairs ( "on-resonance" ) . In addition 2.6 fb _1 was recorded about 
40 MeV below this energy ("off-resonance") to study non-66 continuum. 

The asymmetric beam configuration in the laboratory frame provides a boost to the T(4S) 
increasing the momentum range of the £>-meson decay products up to 4.3 GeV/c. Charged particles 
are detected and their momenta are measured by a combination of a silicon vertex tracker (SVT) 
consisting of five double-sided layers and a 40-layer drift chamber (DCH), both operating in a 1.5 T 
solenoidal magnetic field. Photons are detected by a Csl electromagnetic calorimeter (EMC), which 
provides excellent angular and energy resolution with high efficiency for energies above 20 MeV. 

Charged particle identification (PID) is provided by the specific ionization loss (dE/dx) in the 
tracking devices and by a unique, internally reflecting ring imaging Cherenkov detector (DIRC) 
covering the central region. A Cherenkov angle K-tt separation of better than 4a is achieved for 
tracks below 3 GeV/c momentum, decreasing to 2.5a at the highest momenta in our final states 

§• 

3 Analysis method 

We reconstruct a B meson candidate by combining an r] candidate with a K* candidate. The daugh- 
ter resonance decays are r\ — ► 77, K*° — ► K + ir~ , K* + — ► K®ir + and K® — ► 7r + 7r~ . These modes are 
kinematically distinct from the dominant B decays to heavier charmed daughters. Backgrounds 
come primarily from combinatorics among continuum events in which a light quark pair was pro- 
duced instead of an T(45). 

Monte Carlo (MC) simulations || of the target decay modes and of continuum background were 
used to establish the event selection criteria. They were designed to achieve high efficiency and 
retain sidebands sufficient to characterize the background for subsequent fitting. Photons must 
satisfy E~ > 50 MeV for rj candidates. We select r\ and K* candidates with the requirements 
490 < m 77 < 600 MeV/c 2 , and 800 < m K7T < 990 MeV/c 2 . For K° s candidates we require 
400 < mmc < 600 MeV/c 2 . 

The pion (kaon) daughters of the K* candidates must have DIRC, dE/dx, and EMC responses 
consistent with pions (kaons). For the K®, the three-dimensional flight distance from the event 
primary vertex must exceed 2 mm, the two-dimensional angle between the flight and momentum 
vectors must be less than 40 mrad and the lifetime significance (r /a T ) should be larger than 3. 



A B meson candidate is characterized by two kinematic observables. In the CMS system, due 
to the two-body nature of the B meson production at the T(4S), the B meson candidate's energy 
E B must be equal to y/s/2, where y/s is the center of mass energy. This is taken into account by 
requiring that \AE\ = \E B — y/s/2\ be less than 0.2 GeV, and the beam energy constrained mass 



m EC = V fi 2 ~~ $b i wnere E B and p B are values obtained from a kinematic fit with the constraint 
E* B = Ja/2. 

To discriminate against tau-pair and two-photon background we require the event to contain at 
least three (four) charged tracks for neutral (charged) B meson candidates. To reject continuum 
background we make use of the angle 6t between the thrust axis of the B candidate and the 
rest of the tracks and neutral clusters in the event, calculated in the center-of-mass frame. The 
distribution of cos 8t is sharply peaked near ±1 for combinations drawn from jetlike qq pairs, and 
nearly uniform for the isotropic B meson decays. We require | cos 9t\ < 0.9. 

Event yields are obtained by an unbinned extended maximum likelihood (ML) fit analysis, while 
requirement based analyses are used to validate the results. The input observables are AE, toec, the 
invariant masses m 77 and mx-K of the two resonant daughter candidates and a Fisher discriminant 
J- . The Kg spectrum is not fitted because candidates in the background are dominantly real K®. 
The Fisher discriminant J?]] combines two production angles and a nine bin representation of the 
energy flow about the B decay axis. For the rj mode the helicity angle #]? el is the angle in the 
r\ rest frame between the direction of one of the photons and the rj flight direction. We require 
cos#^ el < 0.92 to discriminate against K*j background. A second B candidate satisfying the 
preliminary requirements occurs in about 11% of the events. In this case the "best" combination 
is selected according to a \ 2 computed from m ri and mx* ■ 

The requirement based analyses use the same variables as the ML fit with tighter selection 
criteria for the signal. A large sideband in the m-ES; AE plane gives an estimate of the continuum 
background which, with appropriate scaling, is subtracted from the raw signal yield. 

We use MC to estimate backgrounds from other B decays, including modes with and without 
charmed daughters. We find these contributions to be negligible. 

The likelihood function for N observed events is 



e 



-£» N 






IlA, 



where the contribution of event i is 






L,% — / y Tlj I j(Xi). 



3=1 

Here rij is the population size for species j (e.g., signal, background) and Vj{xi) the corresponding 
probability distribution function (PDF), evaluated with the observables Xi of the ith. event. 
For the fits £j becomes (with the event index i suppressed on both sides of the equation) 

C = n s Vs + n c V c , 

where ns is the number of signal events and nc is the number of continuum background events. 
These quantities are the free parameters of the ML fit. The probabilities for the components are 
Vs for signal and Vc for background. Since we measure the correlations among the observables in 
the data to be small, we take each Vj to be a product of the PDFs for the separate observables. 

We determine the PDFs for the likelihood fit from simulation for the signal component, and 
off-resonance and on-resonance sideband data for the continuum background. Peaking distributions 



(signal masses, AE, T) are parameterized as "crystal ball shape" ||], double Gaussian or bifurcated 
Gaussian functions. Slowly varying distributions (combinatoric background under mass or energy 
peaks) have polynomial shapes. The combinatoric background in toec is described by a phase 
space motivated empirical function || , the Argus shape. Control samples of B decays to charmed 
final states of similar topology are used to verify the simulated resolutions in AE and ttiec- 

4 Results 

We compute the branching fractions from the fitted signal event yields, reconstruction efficiency, 
daughter branching fractions, and the number of produced B mesons, assuming equal production 
rates of charged and neutral pairs. In Figure [l] the Likelihood function for the two modes is plotted. 




BR(B°^r|K* )(10" 6i 




Figure 1: likelihood functions for B° — > rjK*° (left) and B + 



BR(B + ^nK + )(1(r 
rjK* + (right) branching fractions. 



Table [l] shows for both decay chains the branching fraction we measure, together with the 
quantities entering into its computation. The statistical error on the number of events is taken as 
the shift from the central value that changes the quantity x 2 — — 21n£ by one unit. We also give 
the statistical significance S, computed as the square root of the difference between the value of \ 2 
for zero signal and the value at its minimum. 

In Fig. H we show projections of rriEC f° r both modes. The projections are made by applying a 
requirement on the individual event likelihood (computed without twec) to select the more signal- 
like events. The overlaid curves represent the ML fit PDF scaled to take into account the effect of 
the additional requirement. 

For each measurement the supporting requirement-based analysis yielded compatible results 
with comparable, if somewhat larger, statistical errors. 
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Table 1: signal event yield with statistical uncertainty, detection efficiency (e, %), daughter 
branching fractions (%), significance S, and branching fraction result for each decay chain. 



Mode Signal yield e Y\Bi S £(xl(T 6 ) (CL 90 % ) 



r]K*° 



21 ±6 19.0 26.1 5.4 

14 ±7 17.6 17.9 3.2 22.1^^3.3(33. 



19.8±|-| ± 1.7 

n.i 



% : b° ^ TiK* ^ yyKV BaBar 

g 10 - 




5.22 



5.24 



5.26 



5.28 



5.3 



M(riK*°) (GeV/c 2 ) 




5.22 5.24 5.26 5.28 5.3 

M(r|K* + ) (GeV/c 2 ) 



Figure 2: i? candidate invariant mass for B — > tjK*° (left) and B + — ► r]K* + (right). Histograms 
represent data, and smooth curves represent the fit function. 
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5 Systematic studies 

We have evaluated systematic errors, which are dominated by the PDF uncertainties (6-12%, 
depending on the decay mode). To determine these we varied parameters of the PDFs within their 
uncertainties and estimated the impact on the fit yield. This is the only additive systematic error; 
all others are multiplicative. 

Auxiliary studies lead to systematic errors of 1%, 2.5%, and 5% respectively for the imperfect 
simulation of track, photon, and K® efficiencies. These errors are summed linearly for the B 
daughters. The B production systematic error has been estimated in a separate study to be 1.6%. 
Published world averages |l(| provide the B daughter branching fraction uncertainties. 

Systematic errors associated with the event selection are minimal given the generally loose 
requirements. We account explicitly for |cos#t| (1%)) f° r which we observe a nearly uniform 
distribution in the signal simulation. We also include errors of 4% due to the PID requirements. 

6 Summary 

We have found significant event yields in the decay B — > rjK*, as reported in Table |l[ The final 
results are generally in agreement with those previously reported [pd] ]. We confirm the rather larger 



than predicted |1^] rate for B — ► r\K* obtained by the CLEO Collaboration [11]. The enhancement 



in B — > r]K* could be due to constructively interfering internal penguin diagrams [13] 
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